Real-time Outer Lip Contour Track
نویسنده
چکیده
A new method for tracking outer lip contours of individuals in real world conditions is presented. For an arbitrary speaker, lip color properties are learned for the Bayes decision from the current image frame using the nose tip location as a reference point. Estimated outer contour data is fit to an ellipsoid for further eliminating the effect of outliers in the contour. The algorithm, which is posed as a real-time solution to lip contour tracking in real world conditions, is made efficient by the use of an online learning method. Demonstrations of lip contour tracking and its application to a mouth movement imitation are presented.
منابع مشابه
Real-Time Lip Tracking for Audio-Visual Speech Recognition Applications
Developments in dynamic contour tracking permit sparse representation of the outlines of moving contours. Given the increasing computing power of general-purpose workstations it is now possible to track human faces and parts of faces in real-time without special hardware. This paper describes a real-time lip tracker that uses a Kalman lter based dynamic contour to track the outline of the lips....
متن کاملInitialized Eigenlip Estimator for Fast Lip Tracking Using Linear Regression
Multimodal speech processing in which visual facialfea tures are jointly processed with audio features is a rapidly advancing field. Lip movements and configurations provide useful information to improve speech and speaker recogni tion. However the use of this visual information requires accurate and fast lip tracking algorithms. A new technique is outlined that is able to estimate the outer ...
متن کاملStereo D Lip Tracking
A system is presented that tracks in D a person s un adorned lips and outputs the D locations of the mouth corners and ten points describing the outer lip contour This output is suitable for audio visual speech process ing D animation or expression recognition A stereo head tracker is used to track the subject s head allow ing for robust performance whilst the subject s head is moving and turni...
متن کاملStereo 3d Lip Tracking
Gareth Loy, Roland Goecke, Sebastien Rougeaux and Alexander Zelinsky Research School of Information Sciences and Engineering Australian National University, Canberra 0200, Australia fgareth, roland, rougeaux, [email protected] Abstract A system is presented that tracks in 3D a person's unadorned lips, and outputs the 3D locations of the mouth corners and ten points describing the outer li...
متن کاملAttractor-Guided Particle Filtering for Lip Contour Tracking
We present a lip contour tracking algorithm using attractorguided particle filtering. Usually it is difficult to robustly track the lip contour because the lip contour is highly deformable and the contrast between skin and lip colors is very low. It makes the traditional blind segmentation-based algorithms often fail to have robust and realistic results. But in fact, the lip contour is constrai...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005